How to Deploy a Wire with a Robotic Platform: Learning from Human Visual Demonstrations

In this paper, we address the problem of deploying a wire along a specific path selected by an unskilled user. The robot has to learn the selected path and pass a wire through the peg table by using the same tool. The main contribution regards the hybrid use of Cartesian positions provided by a learning procedure and joint positions obtained by inverse kinematics and motion planning. Some constraints are introduced to deal with non-rigid material without breaks or knots. We took into account a series of metrics to evaluate the robot learning capabilities, all of them over performed the targets

Subject-independent modeling of sEMG signals for the motion of a single robot joint through GMM Modelization

This thesis evaluates the use of a probabilistic model, the Gaussian Mixture Model (GMM), trained through Electromyography (EMG) signals to estimate the bending angle of a single human joint. The GMM is created from the EMG signals collected by different people and the goal is to create a general model based on the data of different subjects. The model is then tested on new, unseen data. The goodness of the estimated data is evaluated by means of Normalized Mean Square Errorope

A first approach to a taxonomy-based classification framework for hand grasps

Many solutions have been proposed to help amputated subjects regain the lost functionality. In order to interact with the outer world and objects that populate it, it is crucial for these subjects to being able to perform essential grasps. In this paper we propose a preliminary solution for the online classification of 8 basics hand grasps by considering physiological signals, namely Surface Electromyography (sEMG), exploiting a quantitative taxonomy of the considered movement. The hierarchical organization of the taxonomy allows a decomposition of the classification phase between couples of movement groups. The idea is that the closest to the roots the more hard is the classification, but on the meantime the miss-classification error is less problematic, since the two movements will be close to each other. The proposed solution is subject-independent, which means that signals from many different subjects are considered by the probabilistic framework to modelize the input signals. The information has been modeled offline by using a Gaussian Mixture Model (GMM), and then testen online on a unseen subject, by using a Gaussian-based classification. In order to be able to process the signal online, an accurate preprocessing phase is needed, in particular, we apply the Wavelet Transform (Wavelet Transform) to the Electromyography (EMG) signal. Thanks to this approach we are able to develop a robust and general solution, which can adapt quickly to new subjects, with no need of long and draining training phase. In this preliminary study we were able to reach a mean accuracy of 76.5%, reaching up to 97.29% in the higher levels

Fast human motion prediction for human-robot collaboration with wearable interfaces

In this paper, we aim at improving human motion prediction during human-robot collaboration in industrial facilities by exploiting contributions from both physical and physiological signals. Improved human-machine collaboration could prove useful in several areas, while it is crucial for interacting robots to understand human movement as soon as possible to avoid accidents and injuries. In this perspective, we propose a novel human-robot interface capable to anticipate the user intention while performing reaching movements on a working bench in order to plan the action of a collaborative robot. The proposed interface can find many applications in the Industry 4.0 framework, where autonomous and collaborative robots will be an essential part of innovative facilities. A motion intention prediction and a motion direction prediction levels have been developed to improve detection speed and accuracy. A Gaussian Mixture Model (GMM) has been trained with IMU and EMG data following an evidence accumulation approach to predict reaching direction. Novel dynamic stopping criteria have been proposed to flexibly adjust the trade-off between early anticipation and accuracy according to the application. The output of the two predictors has been used as external inputs to a Finite State Machine (FSM) to control the behaviour of a physical robot according to user's action or inaction. Results show that our system outperforms previous methods, achieving a real-time classification accuracy of $94.3\pm2.9\%$ after $160.0msec\pm80.0msec$ from movement onset

Quantitative hierarchical representation and comparison of hand grasps from electromyography and kinematic data

Motivation: Modeling human grasping and hand movements is important for robotics, prosthetics and rehabilitation. Several qualitative taxonomies of hand grasps have been proposed in scientific literature. However it is not clear how well they correspond to subjects movements. Objective: In this work we quantitatively analyze the similarity between hand movements in 40 subjects using different features. Methods: Publicly available data from 40 healthy subjects were used for this study. The data include electromyography and kinematic data recorded while the subjects perform 20 hand grasps. The kinematic and myoelectric signal was windowed and several signal features were extracted. Then, for each subject, a set of hierarchical trees was computed for the hand grasps. The obtained results were compared in order to evaluate differences between features and different subjects. Results: The comparison of the signal feature taxonomies revealed a relation among the same subject. The comparison of the subject taxonomies highlighted also a similarity shared between subjects except for rare cases. Conclusions: The results suggest that quantitative hierarchical representations of hand movements can be performed with the proposed approach and the results from different subjects and features can be compared. The presented approach suggests a way to perform a systematic analysis of hand movements and to create a quantitative taxonomy of hand movements

Subject-Independent Frameworks for Robotic Devices: Applying Robot Learning to EMG Signals

The capability of having human and robots cooperating together has increased the interest in the control of robotic devices by means of physiological human signals. In order to achieve this goal it is crucial to be able to catch the human intention of movement and to translate it in a coherent robot action. Up to now, the classical approach when considering physiological signals, and in particular EMG signals, is to focus on the specific subject performing the task since the great complexity of these signals. This thesis aims to expand the state of the art by proposing a general subject-independent framework, able to extract the common constraints of human movement by looking at several demonstration by many different subjects. The variability introduced in the system by multiple demonstrations from many different subjects allows the construction of a robust model of human movement, able to face small variations and signal deterioration. Furthermore, the obtained framework could be used by any subject with no need for long training sessions. The signals undergo to an accurate preprocessing phase, in order to remove noise and artefacts. Following this procedure, we are able to extract significant information to be used in online processes. The human movement can be estimated by using well-established statistical methods in Robot Programming by Demonstration applications, in particular the input can be modelled by using a Gaussian Mixture Model (GMM). The performed movement can be continuously estimated with a Gaussian Mixture Regression (GMR) technique, or it can be identified among a set of possible movements with a Gaussian Mixture Classification (GMC) approach. We improved the results by incorporating some previous information in the model, in order to enriching the knowledge of the system. In particular we considered the hierarchical information provided by a quantitative taxonomy of hand grasps. Thus, we developed the first quantitative taxonomy of hand grasps considering both muscular and kinematic information from 40 subjects. The results proved the feasibility of a subject-independent framework, even by considering physiological signals, like EMG, from a wide number of participants. The proposed solution has been used in two different kinds of applications: (I) for the control of prosthesis devices, and (II) in an Industry 4.0 facility, in order to allow human and robot to work alongside or to cooperate. Indeed, a crucial aspect for making human and robots working together is their mutual knowledge and anticipation of other’s task, and physiological signals are capable to provide a signal even before the movement is started. In this thesis we proposed also an application of Robot Programming by Demonstration in a real industrial facility, in order to optimize the production of electric motor coils. The task was part of the European Robotic Challenge (EuRoC), and the goal was divided in phases of increasing complexity. This solution exploits Machine Learning algorithms, like GMM, and the robustness was assured by considering demonstration of the task from many subjects. We have been able to apply an advanced research topic to a real factory, achieving promising results

A quantitative taxonomy of human hand grasps

Background: A proper modeling of human grasping and of hand movements is fundamental for robotics, prosthetics, physiology and rehabilitation. The taxonomies of hand grasps that have been proposed in scientific literature so far are based on qualitative analyses of the movements and thus they are usually not quantitatively justified. Methods: This paper presents to the best of our knowledge the first quantitative taxonomy of hand grasps based on biomedical data measurements. The taxonomy is based on electromyography and kinematic data recorded from 40 healthy subjects performing 20 unique hand grasps. For each subject, a set of hierarchical trees are computed for several signal features. Afterwards, the trees are combined, first into modality-specific (i.e. muscular and kinematic) taxonomies of hand grasps and then into a general quantitative taxonomy of hand movements. The modality-specific taxonomies provide similar results despite describing different parameters of hand movements, one being muscular and the other kinematic. Results: The general taxonomy merges the kinematic and muscular description into a comprehensive hierarchical structure. The obtained results clarify what has been proposed in the literature so far and they partially confirm the qualitative parameters used to create previous taxonomies of hand grasps. According to the results, hand movements can be divided into five movement categories defined based on the overall grasp shape, finger positioning and muscular activation. Part of the results appears qualitatively in accordance with previous results describing kinematic hand grasping synergies. Conclusions: The taxonomy of hand grasps proposed in this paper clarifies with quantitative measurements what has been proposed in the field on a qualitative basis, thus having a potential impact on several scientific fields

Automated and Flexible Coil Winding Robotic Framework

European electrical machines manufacturers need to increase the flexibility of production process, due to the high cost of equipment setup at the beginning of each new production batch. Overall, most of these European manufacturers are striving to reduce costs while preserving the quality of products, in order to face the competition by Far East companies. There is a strong need for increasing productivity, flexibility and quality. In particular, in wound coils manufacturing process, current technologies allow only to big international manufacturer to automate their production lines, due to high machinery cost and set-up time, while small and medium manufacturers are forced to direct themselves towards manual production. This work aims to reduce costs and increase flexibility with the following contributions: (1) important reduction of setup time and costs of the winding machine, thanks to the simplicity and flexibility of the proposed approach; (2) increase in the quality of the final motors, thanks to the increased amount of copper that the robot will be able to insert in each coil with respect to manual winding; (3) possibility to parallelize the winding operations, dramatically increasing production rate; (4) decreased number of defected cores, thanks to an advanced quality inspection system; (5) reduction of environmental impact of the production process, thanks to a reduction of wasted copper wire

Real-time marker-less multi-person 3D pose estimation in RGB-Depth camera networks

This paper proposes a novel system to estimate and track the 3D poses of multiple persons in calibrated RGB-Depth camera networks. The multi-view 3D pose of each person is computed by a central node which receives the single-view outcomes from each camera of the network. Each single-view outcome is computed by using a CNN for 2D pose estimation and extending the resulting skeletons to 3D by means of the sensor depth. The proposed system is marker-less, multi-person, independent of background and does not make any assumption on people appearance and initial pose. The system provides real-time outcomes, thus being perfectly suited for applications requiring user interaction. Experimental results show the effectiveness of this work with respect to a baseline multi-view approach in different scenarios. To foster research and applications based on this work, we released the source code in OpenPTrack, an open source project for RGB-D people tracking.Comment: Submitted to the 2018 IEEE International Conference on Robotics and Automatio

Covid-19 and the role of smoking: the protocol of the multicentric prospective study COSMO-IT (COvid19 and SMOking in ITaly).

The emergency caused by Covid-19 pandemic raised interest in studying lifestyles and comorbidities as important determinants of poor Covid-19 prognosis. Data on tobacco smoking, alcohol consumption and obesity are still limited, while no data are available on the role of e-cigarettes and heated tobacco products (HTP). To clarify the role of tobacco smoking and other lifestyle habits on COVID-19 severity and progression, we designed a longitudinal observational study titled COvid19 and SMOking in ITaly (COSMO-IT). About 30 Italian hospitals in North, Centre and South of Italy joined the study. Its main aims are: 1) to quantify the role of tobacco smoking and smoking cessation on the severity and progression of COVID-19 in hospitalized patients; 2) to compare smoking prevalence and severity of the disease in relation to smoking in hospitalized COVID-19 patients versus patients treated at home; 3) to quantify the association between other lifestyle factors, such as e-cigarette and HTP use, alcohol and obesity and the risk of unfavourable COVID-19 outcomes. Socio-demographic, lifestyle and medical history information will be gathered for around 3000 hospitalized and 700-1000 home-isolated, laboratory-confirmed, COVID-19 patients. Given the current absence of a vaccine against SARS-COV-2 and the lack of a specific treatment for -COVID-19, prevention strategies are of extreme importance. This project, designed to highly contribute to the international scientific debate on the role of avoidable lifestyle habits on COVID-19 severity, will provide valuable epidemiological data in order to support important recommendations to prevent COVID-19 incidence, progression and mortality